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IN THE CLAIMS 

Please amend the claims as follows. 

1 . (Amended) A business method comprising the steps of: 

5 monitoring one or more multimedia items accessed by a user, each 

multimedia item having two or more disparate modalities, the disparate modalities being 
at least one or more visual modalities and one or more textual modalities; 
for each of the one or more multimedia items: 

(a) creating a visual feature vector for each of the visual modalities 
10 and a textual feature vector for each of the textual modalities; and 

(b) concatenating the visual feature vectors and the textual feature 
vectors into a- one or more unified feature veetOFvectors; 

categorizing at least a portion of each of the multimedia items by 
categorizing the-respective ones of the unified feature veete rvectors ; and 
15 assembling a user profile based on the categorization. 

2. (Original) A business method, as in claim 1, fiirther comprising the step 
of: using the user profile to match one or more multimedia items stored in one or more 
databases. 

20 

3. (Original) A business method, as in claim 2, where one or more of the 
databases are part of a computer that is connected to one or more networks. 

4. (Original) A business method, as in claim 3, where the networks 
25 include any one or more of the following: an Internet, an intranet, an extranet, a corporate 

network, a government network, a infrared network, and a radio frequency network. 

5. (Original) A business method, as in claim 1, where the categories 
include any one or more of the following: a product, a service, an interest, a retail item, a 

30 hobby, a food item, an item of clothing, a travel package, a vacation destination, a 
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financial product, a business partner, a business interest, a medical product, a 
commercial, and a social interest. 

6. (Original) A business method, as in claim 1, where the category 
5 includes any one or more of the following services: consulting, legal, real estate, medical, 
technical, physical training, diet, cosmetic, fashion, governmental, automotive, design, 
architecture, personal assistants, games, on-line games of chance, dating services, and 
landscaping. 

10 7. (Amended) A business method comprising the steps of 

scanning one or more multimedia items in a database, each multimedia 
item having two or more disparate modalities, the disparate modalities being at least one 
or more visual modalities and one or more textual modalities; 

for each of the one or more multimedia items: 
15 (a) creating a visual feature vector for each of the visual modalities 

and a textual feature vector for each of the textual modalities; and 

(b) concatenating the visual feature vectors and the textual feature 
vectors into a one or more unified feature vaeter vectors ; 

categorizing at least a portion of each of the multimedia items by 
20 categorizing the-respective ones of the unified feature veete r vectors ; and 

creating one or more indices of the database based on the categorization. 

8. (Original) A business method, as in claim 7, where the database resides 
on any one or more of the following: a network server, a web site, a personal computer, a 

25 server farm, and a network disk array. 

9. (Original) A business method, as in claim 7, further comprising the step 
of making a business decision based on the classifications. 
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10. (Original) A business method, as in claim 9, where the categorization 
is used to organize a collection of the multimedia items into a database where the 
multimedia items are retrievable based on an annotation of the classification. 

5 11. (Original) A business method, as in claim 10, where the multimedia 

items that are retrieved are used as a response to a query of a search engine. 

12. (Original) A business method, as in claim 9, where the multimedia 
item is a multimedia e-mail and the multimedia e-mail is routed based on one or more of 

10 the categories assigned to the multimedia e-mail. 

13. (Original) A business method, as in claim 12, where the multimedia e- 
mail is routed to any one or more of the following: a sender, a folder, a person, a personal 
folder, a corporate folder, and a corporate department. 

15 

14. (Original) A business method, as in claim 13, where the multimedia e- 
mail is multiplied before being routed. 

15. (Amended) A business method comprising the steps of: 

20 scanning one or more multimedia items in a database, each multimedia 

item having two or more disparate modalities, the disparate modalities being at least one 
or more visual modalities and one or more textual modalities; 

for each of the one or m^ore multimedia items: 

(a) _creating a visual feature vector for each of the visual modalities 
25 and a textual feature vector for each of the textual modalities; and 

(b) concatenatinR the visual feature vectors and the textual feature 
vectors into a one or more unified feature veeter vectors ; 

categorizing at least a portion of each of the multimedia items by 
categorizing-ttie respective ones of the unified feature veete f vectors : 
30 comparing one or more of the unified feature vectors to one or more other 

feature vectors; and 



5 



Docket No.: YOR920010536US1 



making a decision based on the comparison. 

16. (Original) A business method, as in claim 15, where the multimedia 
items are digital multimedia copies and the feature vectors represent restricted 

5 multimedia items and the comparison determines if the digital multimedia copies are 
similar to the restricted multimedia items and the decision is that the digital multimedia 
copies are subject to a second restriction. 

17. (Original) A business method, as in claim 16, where the second 
10 restriction includes any one or more of the following: a copyright restriction, a trademark 

restriction, intellectual property restriction, parental guidance restriction, common 
decency restrictions, user-defined restrictions. 

18. (Original) A business method, as in claim 16, where the digital 
15 multimedia copies are accessible over the Internet. 

19. (Original) A business method, as in claim 15, where the comparison 
indicates a degree of similarity and the decision is that the multimedia item contains a 
known content. 
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